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(54) image data illegal use prevention system 

(57) An image data illegal use prevention system 
includes an image data fetching unit (6) for fetching dig- 
ital image data in which electronic watermark data may 
be embedded, and an electronic watermark data detec- 
tion unit (8) for detecting electronk; watermark data from 
the image data fetched by the image data fetching unit 
(6). tf electronic watermark data are detected by the 
electronic watermark data detection unit (8), then an 
image data recording unit (7) does not record the image 
data fetched by the image data fetching unit (6) onto a 
recording medium (9). thereby preventing illegal dupli- 
cation. The electronic watermark data are calculated, 
fa example, in accordance with an expresskMi deter- 
mined in advance for frequency components of discrete 
cosine transformed digital image data. 
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Description 

This inverrticxi relates to digital image processing. 
arti more particularty to a system for preventing illegal 
use of cngital Image data. 

2. Description of the Prefen^ed Embocfiment 

In recent years, illegal duplication of a digital image 
has become a problem. 

In order to pres^ent illegal duplication, a system has 
been proposed wherein digital image data are ciphered 
such that only a reproduction system having a legal 
decipherment key can reproduce the ciphered digital 
image data, However, once the cipher is deciphered, 
later duplication cannot be prevented. 

Thus, a system wherein a unique identification 
code is recorded on a recording medium to indicate per- 
mission or inhibition of duplication (refer to Japanese 
Patent Laid-Open Application Na Heisei 8-69419), 
another system wherein decoders for subscription tele- 
vision broadcasting have different identification codes 
from one another recorded therein such that only those 
decoders which have contracted Identification codes 
can effect con-ect decoding (refer to Japanese Patent 
Laid-Open Application No Heisei 5-260468) and so 
forth have been proposed. 

Further, in order to prevent illegal use and duplica- 
tion of a digital Image, also a method has been pro- 
posed wherein special informatioa that is. electronic 
watemnaric data, is embedded into the digital image 
itself. As such electronic watermaric data for a digital 
image as descrft>ed above, two kinds of electronic 
watermark data of visible electronic watermark data and 
invisit»le electronic watermark data are availat)le. 

The visible electronic watermark date are used 
such that a special character or symbol or the like is 
combined with an image so that it may be visually rec- 
ognized. While the visble electronk: watermaric data 
deteriorate the picture quality, they have an effect of vis- 
ually appealing to a user of a digital image for preven- 
tk>n of Illegal use of the digital imaga 

An exarrple of embedding of visble electronic 
watermari( data is discfosed in Japanese Patent LakJ- 
Open Appllcatfon Na Heisei 8-241403. According to the 
method disctosed bi the document just mentfoned. 
when visble electronic watermaric data are combined 
with an original image, only the t)rightness components 
of tfiose pixels which correspond to opaque ones of the 
electronic watermaric data are varied while cola com- 
ponents of the pixels are nor varied. In tNs kistence. the 
scaling factor by which the brightness conponents of 
pixels are varied is determined based on ootor compo- 
nents, random numbers, values of pixels of the elec- 
tronic watermark data and so forth. 

On the other hand, the invisUe electronic water- 
maric data are electronic watermaric data embedded in 
an image 80 that the picture quality may not be deterio- 



rated. Since the invisUe electronic watermark data little 
deteriorate the picture quality, they are characterized in 
that they cannot be recognized visually. 

However, if special informatfon which allows kienti- 

5 ficatlon of an author is embedded as the electronic 
watermaric data, then even after illegal diplk^atfon is 
perfonned. the author can be spec^ied by detecting the 
electronic watemiaric data. On the other hand, if dupli- 
cation inhibition informatfon Is embedded, then, for 

10 example, when a reproduction apparatus detects the 
diplicatfon inhibition Information, it is possible to notify 
the user that duplication of the data Is inhbited or to 
render a duplfoation prevention mechanism in the repro- 
duction apparatus operative to limit duplfoation of the 

15 data by a vkJeo tape recorder (VTR) or the like. 

One of available methods of embedding invisible 
electronic watenmark data into a digital image is to 
embed special information as electronic watermaric 
data into a portfon of pixel data such as the LSB (least 

20 significant bit) whfoh has a comparatively little influence 
on the pfoture quality. In other words, this method can 
be regarded as a method whfoh inserts electronic 
watermaric data into a waveform with respect to time erf 
an image signal. However, where this metiiod is 

25 applied, electronic watermark data can be renxved 
readily from an imaga For exanrple, if a fow-pass titer is 
used, then information of the LSB of a pixel is fosL Fur- 
ther, electronic watermark data are lost also by Image 
compression processing since the image compressfon 

30 processing reduces the data amount by renxiving infor- 
mation at such a portion which has a comparatively little 
influence on the pfoture c^lity as mentioned above. 
Consequently, the method descrbed above Is disad- 
vantageous in ttiat it is cfiff kxrtt to re-detect the electronic 

35 watermaric data. 

Thus, anotiner method has been proposed wherein 
an Image frequency converted and electronfo water- 
mark data are embedded into a resulting frequency 
spectmm {Nikkei Electronics, April 22, 1996, Na 660. 

40 pl13). In this method, since electronic watermaric data 
are embedded Into frequency components, the elec- 
tronic watermark data are not lost even t>y knage 
processing such as compression processing or filtering. 
Further, rancfom numbers which exhbit a normal distrl- 

45 bution are adapted as the electronic watermaric data in 
order to prevent krterference between electronic water- 
mark data and make It difficult to destroy electronfo 
watermaric data without having a signiffoant influence on 
the entire Imaga 

60 In a method of embecfoing electronfo watennark 
data, an origbial image D is cfivided krto bfocks of 8 pix- 
els x 8 pixels, and electronfo watermaric data are 
embedded regarding each block as a processing unit 
Also extraction processing of the electronfo watermark 

65 dataisperibrmedinunltsofabfock. 

In electronfo watermark data embedding process- 
ing, data are first set successively as f (I). f(2) f(n) in 

the ascending order of the frequency component of an 
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AC component in a frequency region after discrete 
cosine transform (OCT) in MPEG (Moving Picture 
Experts Group) coding processing is conrpleted. and 

electronic watermark data w(1). w(2) 2(n) are 

selected from within a norma! distrftxition whose aver- 5 
age is 0 and whose dispersion is 1. and then 

FG) = Ki) + a*avg(f(i))*w(i) 

is calculated for the individual values of i, where a is a 10 
scaling factor, and avg(f(i)) is a partial average which is 
an average of at>solute values of three neightxving 
points to the point f(i). Then, succeeding processing of 
MPEG coding processing is perfonned replacing f(i) 
with F(0. IS 

Detection of electronic watermark data is per- 
formed in accordance with a nrathod descrfced below. 
In the det6Ctk>n method, an original image is not 
required, but only it Is required that electronic water- 
mark data candidates w(i) (where I « 1, 2, .... n) be £0 
known. 

In a frequency regk)n of each bk)ck after dequanti- 
zation of MPEG decompression processing is com- 
pleted, data are represented as F(2). F(2) F(n) in the 

ascending order of the frequency component. Average 2s 
values of absolute values of three neighboring points to 
each point F(i) are represented as partial averages 
avg(F(i)), and electronic watermark data W(i) are calcu- 
lated in accordance with 

30 

W(i)-F(i)/avg(F(i)). 

Further, sum totals WF(0 of W(0 for one image are cal- 
culated for the indivkhial i. 

Thereafter, making use of an inner product of vec- 35 
tors, a statistical similarity between the electronic water- 
mark data w(i) and the sum totals WF(i) is catoulated In 
accordance with 

C-WF*w/(WFD*WD) 40 

where W - {WF(1), WF(2). .... WF(n)). w - (w(1). w(2). 
.... w(n)), WFD - absolute value of the vecta WF, and 
wD m absolute value of the vector w. When the statistical 
similarity C has a vakie higher than a particular value, it 45 
is discriminated that the electronic watermark data are 
embedded. 

However, where the method described above is 
employed, if image data are regarded as a mere single 
blockof digital data on a personal computer, they can be so 
di4>licated by a desired number off times using a copy 
conrvnand of operation system software off the Windows, 
MS-DOS (both trade marks of MicroeofQ or the lika 

Further, with a system which handles a (Sgital 
Image such as a di(^ vUeo recorder, a copying 55 
machine a a facsimOe. since a copy of data can be pro- 
duced simply, It Itself cannot be prevented that digital 
Inrage data including electronic watermark data are 



duplicated as they ara 

It is an object of the present invention to proMde em 
image data aiegal use prevention system which can pre- 
vent iHegal use of digital image data without deteriora- 
tion of the pk:ture quafrty and allows, even if d^iital 
image data are duplicated, identifbation of the owner- 
ship from the duplk^ate. 

In order to attain tiie object desaibed above, 
according to an aspect of tiie present invention, there is 
provided an image data illegal use prevention system, 
comprising image data fetching means for fetching dig- 
ital image data in whk:h electronic watermark data may 
be embedded, electronic watermark data detection 
means for detecting electronic watermark data from ttie 
image data fetched by the image data fetching means, 
and transfer inhbition means for inhibiting, if electronic 
watermark data are detected by the electronk; water- 
mark data detection means, transfer of the image data 
fetched by the image data fetching means to a transfer 
destination. 

According to another aspect of the present inven- 
tion, ttiere is provkJed an image data illegal use preven- 
tion system, comprising image data fetching means for 
fetching digital image data in which electronic water- 
mark data may be embedded, electronic watermark 
data detection means for detecting electronic water- 
mark data from the image data fetched the image 
data fetching means, and transfer means for transfer- 
ring, if electronic water mark data are detected by the 
electronic watermark data detection means, data differ- 
ent from the image data fetched by the image data 
fetching means to a transfer destination. Preferably, tfie 
different data are data obtained by superposing data 
obtained by muttiptying the electronfo watermark data 
by a constant on ttie image data fetched by the image 
data fetching means. 

According to a furttier aspect of the present inven- 
tion, there is provkled an image data illegal use preven- 
tion system, comprising image data fetching means for 
fetching digital image data in whrch electronic water- 
mark data may be embedded, electronic watermark 
data detection means for detecting the electronic water- 
n\axk data from the image data fetched by the image 
data fetching means, and transfer inhibition means for 
discriminating whettier the detected electronic water- 
mask data Mfoate transfer permissfon or inhi)itksn and 
inhixting, when ttie detected electronk; water mark data 
indicate transfer inhbition, a transfenrlng operation of 
the fetched image data to a transfer destination. Prefer- 
ably, the transfer inhfoition means discriminates^ when 
the detected electronic watemriark data include a value 
representing that the tranter permission time nunt)er is 
zero, that tiie detected electronic watemrtark data are 
electronic watermark data Indicating transfer inhbition. 

According to a still further aspect of the present 
invention, there is provkied an image data Hlegal use 
inhbition system, comprising image data ieiching 
means for fetching digital brnge data In whfoh electronk; 
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watermark data indudtng a value indicating that the 
transfer permission time nunrt)er is m may be embed- 
ded, watermark data embedding means for emt>edding, 
into the fetched image data, new electronic watermark 
data which includes a value indicating that the transfer 
permtesion time number is smaller by one than the pre- 
ceding value of m, and transfer means for transfemng 
the image data in which the new electronic watermark 
data are embedded to a transfer destination. 

In the image data illegal use inhibition systems, the 
electronic watermark ctata may be cateutated in accord- 
ance with a predetermined expressfon using frequency 
components of the digital image data obtained by dis- 
crete cosine transfomx Otherwise, any of the Image 
data illegal use inhi>itk)n system may be constructed 
suc^ that the image data fetching means fetches digital 
image data from a recording medium on which the dig- 
ital image data are recorded, and the transfer destina- 
tk>n is a recording medium different from the recording 
medium on which the digital Image data are recorded. 

It is to be noted that in the present specification, 
the word "trar^fer* includes transmission of digital 
Image data from a source by or in whk:h the digital 
image data are produced or stored to another element, 
storage of such digital image data into or onto another 
medium, duplication of digital image data from a record- 
ing medium in which the digital image data are recorded 
to another recording medium, duplication of a ffle k>y a 
computer and so forth and should be interpreted widely 
as any operatfon which makes digital image data in 
such a form as allows use of the digital image data. 

With the image data illegal use prevention systems 
described atxyve, duplication of image data can be pre- 
vented without deterioratk3n of the picture quality using 
an electronic watennark technique. Consequently, the 
image data illegal use prevention systems can be 
applied to vanous image processing systems. 

Further, Illegal copying can be prevented without 
any limitatfon to a medium of copying source data and 
to a medium of a copying destinatkyi. and even if data 
are copied illegally, if copyright data are embedded as 
watermark data In the data, then a person who has the 
ownership of the image data can be identified by inves- 
tigating the watermark data and a person who has per- 
formed illegal du|)lication can be specified. 

The above and other objects, features and advan- 
tages of the present invention will become apparent 
from the following description and the appended dains, 
taken in conjunction with the accompanying drawings in 
which like parts or elements are denoted by like refer- 
ence characters. 

FIG. 1 is a block diagram showing a basic construc- 
tkm of an Image data ilegal use preventfon system 
according to the present inventfon; 
FIQ. 2 is a tkxk diagram showrig an exemplary 
constructfon of a watermark data embedding unit 
shown in FK1 1; 



FIG. 3 is a bk>ck diagram showing an exemplary 
construction of a watermark data detection unit 
shown in FIQ. 1; 

FIQ. 4 is a bfock diagram of a digital video system 
5 to which the Itrxage data illegal use prevention sys- 
tem of Fia 1 is applied; 

FIQ. 5 is a block diagram of a digital copying system 
to which the Image data illegal use prevention sys- 
tem of FIG. 1 is applied; 

10 FIG. 6 is a block diagram of a form of an image pro- 
duction and recording apparatus shewn in FIG. 1 
where it is formed as a printer system; 
FIG. 7 is a block diagram of a form of an image 
duplicatfon apparatus shown in FIQ. 1 where tt is 

15 formed as a facsimile system; 

FIG. 8 is a block diagram of another form of the 
image duplication apparatus shown in FIG. 1 where 
it is famed as a capture board system; 
FIG. 9 is a block diagram of a data transfer system 

so to which an image data illegal use prevention sys- 
tem according to the present invention is applied; 
FIQ. 10 is a fkMT chart illustrating operation of the 
data transfer system of FIG. 9; and 
FIQ. 11 is a bfock diagram showing an exemplary 

25 construction of a watermark data detection/embed- 
ding unit shown in FIG. 9. 

FIG. 1 shows a basic constructfon of an image data 
illegal use preventfon system to wNch the present 

30 invention is applied. The image data illegal use preven- 
tion system includes two principal components of an 
image production and recording apparatus 100 and an 
image duplicatfon apparatus 1 01 . The image production 
and recording apparatus 100 is composed of an image 

35 data productfon unit 1. a watermark data embedding 
unit 2. a watermark data table 3 and an image recording 
unit 4. Meanwhile, the arage duplication apparatus 101 
is composed of an image data fetching unit 5, an Image 
data recording unit 7 and a watermark data detection 

40 unite. 

In the ^ge production and recording apparatus 
1 00, digital image data produced by the Image data pro- 
duction unit 1 are sent to the watemnark data embed- 
ding unit 2. The watermark data embedding unit 2 

45 inserts el ectronic watermark data of the watemnark data 
table 3 into the digital image data In such a manner as 
hereinafter described. The image data recording unit 4 
records the digital image data, In which the electronic 
watermark data are embedded, onto a recording 

60 medium 5. 

In the image duplication apparatus 101, the image 
data fetching unit 6 fetches the dK^ltal image data 
recorded on the recording medium 5. The watermark 
data detection unit 8 detects the electronfo watermark 

65 data k\ the digital Image data fetched by the Image data 
fetching unit 6 in such a manner as hereinafter 
described. The image data reoon^ imit 7 records, if 
the image data fetching unit 6 does not detect electronfo 



4 



7 



EP0 854 633 A2 



8 



watermark data, the digital image data orrto another 
recording medium 9 to produce a duplicate, but does 
not perform, if electronic watermark data are detected, 
recording of, the digital Image data onto the recording 
medium 9. 5 

FIG. 2 shews an exerrplary oonstructk>n of the 
watermark data embedding unit 2. Digrtal image data 
from the image data productkw unit 1 of FK3. 1 , that fe, 
discrete cosine transformed MPEG image data, are 
inputted to a partial average calculation section 1 11 and io 
an adder 1 14. The digital image data are represented 
as f 0) (i - 1 . 2 n) for the convenience of description. 

The partial average calculatfon section 111 calcu- 
lates partial averages descnbed hereinabove In accord- 
ance with arg(f(0)-(tf(i-1)| + tf(OI+|f(H-1)|V3 and is 
supplies a result of the calculation to one of Input termi- 
nals of a multiplier 1 12. 

To the other input terminal of the multiplier 112. 
electronic watermark data w(i) are supplied from the 
watermark data table 3. An output of the multipfier 1 12 20 
is multiplied by a scaling factor a by a multiplier 1 13, and 
a result of the multiplicatton is added to the digital image 
data by the adder 114. A result of the addition, that ^ 
image data (f(i) + a * arg(f(i)) * w(i)) in which the elec- 
tronic watermark data are embedded, are obtained from 2s 
the adder 1 1 4 and supplied to the image data recording 
unit 4 of FIG. 1. 

FIG. 3 shows an example of a construction of the 
watermark data detection unit 8. Data F(i) fetched by 
the image data fetching unit 6 of FIG. 1 are supplied to 30 
a partial average calculation section 1 15 and a divider 
116. The partial average calculatton section 1 15 calcu- 
lates partial averages avg(F(0) mentioned hereinabova 
This cateulation is performed, for example. In accord- 
ance wrth avg{F(0) - (|Fp-1 1 + |F(i)| + |F0+1)D/3 . The 35 
divkier 1 16 performs cakxilation of W(i) « F(i)/avg(F(i)) . 

Then, an adder 117 cakxilates, for the indivkJual 
values of i, sum totals WF(i) of the thus calculated val- 
ues W(i) for one Image, Then, the sum totals WF(i) are 
supplied to an inner product caloilation sectkxi 1 18, by 40 
which inner products thereof with electronic watermark 
data w{t) of an object of detection are calculated. The 
calculation of the inner product calcUatfon section 1 18 
is represented In the foflowing manner. 

45 

C«WF*w/(WFD*wD) 

where WF is a vector whose elements are WF{1), 

WF(2) WF(n). w is a vector whose elements are 

w(1). w(2) w(n), WFD an absolute value of the so 

vector WF. and wD is an absolute value of the vector w. 

The Inner product calculatfon section 118 calcu- 
lates inner products C for all of possible ones of elec- 
tronic watermark data and suppGes the Irmr products C 
to a similarity discriminatfonsectfon 11 9. ss 

The similarity discrimination sectfon 119 detects 
thoee electronic watermark data wNch maximize the 
Inner products C. and sends out a result of the detectfon 



to the image data recording unit 7 of FIG. 1 . 

FIG. 4 shows a digrtal video system to whkii the 
image data illegal use prevention system of FIG. 1 is 
applied. Referring to FIG. 4. in the digrtal vfoeo system 
shown, the image production and recording apparatus 
100 shown in FIG. 1 is formed as a vkleo camera lOOA 
and the image duplicatfon apparatus 1 01 is formed as a 
video recorder 101A. 

In the video camera 100A. an image imaged by an 
imaging section 11 is sent as digital image data to a 
watermark data embedding section 12. Meanwhile, 
electronic watermark data to be embedded into dotal 
image data are stored in a watermark data table 13. 
Thus, the electronk: watermark data are read cul from 
the watermark data tat)le 13 and sent to the electrons 
watermark data embedding sectfon 12. The watermark 
data embedding section 12 inserts the electronk; water- 
mark data into the digital image data sent thereto in 
such a manner as descrik>ed above. The digrtal image 
data in which the electronic watenmarkdata are inserted 
are stored onto a recording medium 15 such as a mag- 
netk; tape or an optical disk by a recording sectfon 14. 

When a duplicate is to be produced, the dKittal 
image data stored on the recording medium 15 are 
reproduced by a reproduction section 16 of the video 
recorder 101 A. Normally, the digital image data are 
stored onto a recording medium 1 9 again l3y a recoiding 
section 1 7 to produce a dupficate. However, if electronic 
watermark data are inserted in the digital image data 
reproduced by the reproduction section 16. that is. if 
electronic watermark data are detected by a watermark 
data detection section 18, then such detecticn is 
reported to the recording section 17. When the detec- 
tfon of electronic watermark data is reported, the 
recording section 17 does not perform storage of the 
digrtal image data onto the recording medium 19. 
thereby preventing aiegal duplication. 

Alternatively, when electronfo watermark data are 
detected, dummy data may be supplied to the recording 
section 17 a data obtained by mutt^ng the water- 
mark data stored in the watermark data detectfon sec- 
tion 18 by a constant so that the data may have a 
maximum magnitude sutjstantialty equivalent to the 
dynamic range of the image data may be added to 
reproduced image data and sent to the recording sec- 
tion 17. tf such data are supplied to the recording sec- 
tion 17. then an Image quite different from the original 
image is outputted from ttie recording section 17. and 
consequently, illegal duplicatfon can be prevented even 
if a dupOcation operation is not inhit>ited. 

FIG. 5 shows a digrtal copying system to wtiich the 
^ge data iHegal use prevention system shown in FIG. 
1 is applied. Referring to FIG. 5. in the digital copying 
system shown, the image production and recording 
apparatus 100 shown in FIG. 1 is fonned as a rust cop- 
ying macNne 100B and the image duplication appara- 
tus 101 is formed 88 a second copying machine 101 B. 

An original image 20 fetched fciy a scanning sectfon 
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21 of the first copying machine 100B is sent as digital 
image data to a watermark data embedding section 22. 
Meanwhile, electronic watenmark data to be 6mt>edded 
into digital image data are stored in a watermark data 
table 23. and they are read out from the watermark data 
table 23 and sent to the watermark data embedding 
sectk)n 22. The watermark data embedding section 22 
inserts the electronic watermark data into the digital 
image data sent thereto. The dgital image data in which 
the electronic watermark data are inserted are printed 
on copy paper 25 t)y a printing sectkHi 24. 

In the second copying machine 101 B. the image 
printed on the copy paper 25 is fetched and converted 
t>ack into digital image data by a scanning section 26. 
Nk)rmally. the digital image data are printed on copy 
paper 29 again by a printing section 27 to produce a 
duplicate. However, if electronic watermark data are 
inserted in the distal inage data fetched by the scan- 
ning section 26. that is, if electronic watermark data are 
detected by a watermark data detection sectk)n 28, then 
such detection is reported to the printing sectk>n 27. 
The printing section 27 does not perform, when the 
detection of electronic watermark data is reported, 
printing of the digital image data onto the copy paper 29. 
thereby preventing illegal copying. 

Attematively. when the electronic watermark data 
are detected, dummy data may be supplied to the print- 
ing section 27 or data obtained by multiplying the water- 
mark data stored in the watermark data detectfon 
section 28 by a constant so that they may have a maxi- 
mum magnitude substantially equal to the dynamic 
range of the image data may be added to (superposed 
on) the reproduced image data and sent to the printing 
section 27. tf such data are supplied to the printing sec- 
tion, then an image quite different from the original 
image is outputted from the printing section 27. Conse- 
quentiy. Hlegal copying can be prevented even if a copy- 
ing operatfon is not inhibited. 

FIQ. 6 shows a printer system which makes use of 
a personal computer. Referring to FIG. 6. the printer 
system 100C shown operates as the image productfon 
and recording apparatus 100 de6cri}ed hereinabove 
with reference to FIQ. 1. In the printer system 100C. 
electronk; watermaric data to be embedded Into digital 
image data are stored in a watermark data table 33. A 
watermark data embedding section 32 inserts tiie elec- 
tronic watermark data from the watermark data table 33 
into digital image data sent thereto from a personal 
computer 31 and sends resulting data to a printing sec- 
tion 34. The printing section 34 prints the digital Image 
data, k\ wfiich the electronic watermark data are 
inserted, on print paper 35. Consequently, even if it is 
tried to duplicate the digital image data using, for exam- 
ple, the copying machine 101 B of FIQ. 5, since the etec- 
tronic watermark data are detected by the watermark 
data detection section 28, illegal copying can be pre- 
vented. 

FIQ. 7 shows a facsimile system. Refming to FK3. 



7. the facsimile system 101C shown operates as the the 
image duplication apparatus 101 descn'bed herein- 
above with reference to FIQ. 1 . In the facsimie system 
101C, when image data transmitted through a tele- 

5 phone line are received by a rrxxiem 41 . ttie kmge data 
are normally sent to a printing sectk)n 42. by which they 
are printed on facsimile paper 44. Where the received 
image data are digital image representing an kmge in 
which electronic watermark data are inserted like an 

w image printed, for example, by the printer system lOOC 
of FIG. 6. it is checked by a watermark data detection 
section 43 whether or not electronic watermark data are 
inserted In the digital image data, tf electronic water- 
mark data are detected then such detection is reported 

75 to ttie printing section 42. When the detection of elec- 
tronic watemnartc data is reported, ttie printing section 
42 does not perform a printing operation, thereby pre- 
venting illegal duplication. 

Atternativety. if electronic watermark data are 

20 detected, then dummy data may be supplied to ttie 
printing section 42 or data obtained by multiplying the 
watermark data stored in ttie watennaric data detection 
section 43 by a constant so that ttiey may have a maxi- 
mum magnitude sut^stantially equal to the dynamic 

2s range of the image data may be added to (superposed 
on) the restored image data and sent to the printing sec- 
tion 42. If such data are received by the printing section 
42, tiien an image quite different from the original image 
is outputted from the printing sectfon 42. Consequentiy, 

30 illegal printing can be presented even if a printing oper- 
ation is not inhibited. 

FIG. 8 shows a capture board systent Referring to 
FIG. 8, the capture board system 1 01 D shown operates 
as ttie the image duplk:ation apparatus 101 descrfoed 

35 hereinabove witti reference to FIG. 1. In ttie capture 
board system 101 D, image data fetched by image data 
fetching unit 51 are normally sent to a captive appara- 
tus 52. by which ttiey are stored into an external staage 
apparatus 54. If the image data are digital image data in 

40 which electronic watermark data are inserted Kke an 
image stored, for example, by ttie video camera 100A of 
FIG. 4, then it is checked t^ an electronic watermark 
data detection apparatus 53 whether or not electronic 
watermark data are inserted in ttie digital image data If 

45 electronic watermark data are detected, ttien sudi 
detection is reported to ttie capture apparatus 52. The 
capture apparatus 52 does not perform, when such 
detection of electronic watermark data is reported, a 
staring operatfon of data, thereby preventing illegal 

60 diplication. 

Alternatively, if electronic watermark data are 
detected, then dunrvny data may t}e supplied to the cap- 
ture apparatus 52 or data obtakied by multiplying the 
watermark data staed k\ ttie watermartc data detection 

55 apparatus 53 by a constant so ttiat ttiey may have a 
maximum magnitude substantially equal to ttie dynamic 
range of ttie Image data may be added to (superposed 
on) ttie restored Image data and sent to ttie capture 
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apparatus 52. tf auch data are received by the capture 
apparatus, then an image quite different from the origi- 
nal image ts outputted from the capture apparatus 52. 
Consequently, illegal storage can be prevented even if a 
storing operation Is not inhibited. 5 

FIG. 9 shows a data transfer system to which an 
Image data illegal use prevention system according to 
the present invention is applied. In the data transfer sys- 
tem, data are transf en'ed from a storage unit of a trans- 
fer source to a storage unit of a transfer destination so 10 
that they may be copied. Refen-ing to FIQ. 9. an input- 
ting unit 61 checks whether or not there is a command 
inputted thereta If an inputted command is present 
then it is analyzed by a copy command analysis unit 62 
what the inputted command is. If it is discriminated, as a is 
result off the analysis, that the inputted command \s a 
command to copy transfer source data 69 of a storage 
medium 66 of a transfer source to a transfer destination 
data area 70 of a storage medium 67 of a transfer des- 
ignation, then a command is sent to a copying process- 20 
ing execution unit 63 so that copying processing may be 
executed. TTie copying processing execution unit 63 
transfers the transfer source data 69 stored in the stor- 
age medium 66 of the transfer destination to temporary 
storage unit 65 and then causes the thus transfen-ed 2s 
data 69 to be checked by a watermark data detec- 
tk)n/embedding unit 64. The watermark data detec- 
tion/emk>edding unit 64 detects presence or absence of 
watermark data in the data 69 and discriminates, if 
watermark data are detected. whk:h one of permissk>n so 
and inhibition of copying the watermark data indicate. 

If a result of detectk)n of watermark data Indicates 
pemnission of copying, then the transfer source data 69 
stored in the temporary storage unit 65 are copied Into 
the transfer destinatk>n data area 70 of the storage ss 
medium 67. However, if the detected watermark data 
indicates permtesk)n of copying by m times, than 
dequantized data in which new watermark data are 
embedded are sent from the watermark data detec- 
tkKi/embedding unit 64 to the copying processing exe- 40 
cuta'on unit 63 and staed into the trartsfer destinatkxi 
data area 70 of the storage medium 67 of the transfer 
destinatkxi, and copying m executed. Then. tnk>rmatk)n 
representing what coping has been performed by the 
copying processing executkxi unit 63 is sent to and dis- 45 
played tjy display unit 68. thereby ending the copying 
processing. If the detected watermark data indicate 
inhibition of copying, then no copying Is performed. 

Subsequently, operatkxi off copying processrig by 
the data transfer system of FIQ. 9 is described with ref- bo 
erence to afksw chart of FIQ. 10. 

The copying processing executkxi unit 63 reads out 
the transfer source data 69 from the storage medium 66 
off the transfer source in step A1 . In step A2. the transfer 
source data 69 are Inputted to the copy command anal- ss 
ysts unit 62. by which a header of MPEQ data is ana- 
lyzed to discriminate whether a not the data are MPEQ 
Image data. 



If the transfer source data 69 are MPEG image 
data, then variable length decoding proc^ng frv 
dequantized data is performed in step A3, and the vari- 
able length coded data are dequantized in step A4. The 
dequantized data are sipplied to the watermaric data 
detectfon/embedding unit 64, by which watennark data 
are detected. In step A6. discriminatran off the detected 
watermark data is performed. 

If the watermark data detected in step A5 indicate 
inhbition of copying, then the confrol jumps without 
doing anything to step A13. in which the processing is 
ended. 

Iff the watermartc data detected in step AS indrcate 
that there is no limitatkHi to the number of times in cop- 
ying, the control jumps to step A1 2, in wNch the transfer 
source data 69 are copied into the transfer destinatfon 
data area 70, whereafter the confrol jumps to step A1 3, 
in which the processing is ended. 

If the watermaric data detected in step AS indicate 
permissfon of copying by m (m « 1 to 1^ times, m is 
updated to m = m-1 In step A7. Then, in step AS, water- 
mark data indicating pemriission of copying by m times 
are embedded into the data dequantized in step A4. 

Then, if m ^ 0 in step A9. then the data into which 
the watermark data indicating permission of copying by 
m times have been embedded in step A8 are quantized 
in step A10. The quantized data are variable length 
coded in step A1 1. The data variable length coded and 
converted into MPEG image data are inputted in step 
A1 2 to the copying processing executkKi unit 63. by 
which copying processing of them is performed. 

Iff m < 0 In step A9, then since this signifies tfiat cop- 
ying is inhibited, tiie processing is ended. 

Subsequentiy. an exenrplary consfruction of the 
watermark data detection/embedding unit 64 is 
descrbed witti refer^ice to FIG. 11. The watermark 
data detection/enit>edding unit 64 is formed from an 
electronic watermark data embedding section 64A and 
an elecfronic watermark data detection sectkxi 64B. 

The elecfronic watermari< data detection section 
64B has a construction same as that off the watermark 
data detection unit 8 shown in FIG. 3. and the MPEG 
data F(i) decoded in step A3 of FIG. 10 are suppOed to 
the partial average cafoulation section 111 and the mul- 
tiplier 112. The partial average cafoulation section 1 1 1 
calculates partial averages avg(F(i)) mentioned herein- 
above. The divider 116 performs calculation of 
W(i).F(0/avg(FO)). 

Then, the adder 1 17 calculates, for tiie individual i. 
sum totals WF(i) of the cafoulated values W(i) for one 
hnaga Then, the sum totals WF(i) are supplied to tiie 
inner product calculation section 118, by whi^ inner 
product calculation with the waterntarkdata w(i) is per- 
formed. 

The inner product calculation section 118 calcu- 
tates inner products C for alt off possible watermark data 
and suppGes the thus calculated Inner products C to the 
similarity discrimination section 119. 
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The simitanty discrinvnation section 119 detects 
that watermark data with which the inner product C 
exhibits a maximum value, and sends out a result of the 
detection to the copying processing execution unit 63 of 
FIG. 9. 5 

The electronic watermark data embedding section 
64A has a construction same as that of the watermark 
data embedding unit 2 shown in FIQ. 2. and the transfer 
source data from which the original watermark data 
have been renrioved in step A5 of FIG. 1 0 are Inputted to io 
the partial average calculation section 111 and the 
adder 114. 

The partial average caloiation section 1 1 1 calcu- 
lates a partial average described hereinabove and sup- 
plies a result of the cateulation to one of input temninals is 
of the multiplier 112. 

To the other input terminal of the multiplier 1 12. the 
watemiark data w(i) whi<^ indicate the value of m deter- 
mined in step A7 of FIG. 10 are supplied. An output of 
the multiplier 1 12 is multiplied by a scaling factor a by so 
the multiplier 113. and a result of the multiplication is 
added to the digital image data by the adder 114. A 
result of the addition, that Is. image data 
(FO) + a * arg(f{i)) * wO)) in which the new watermark 
data are embedded, are obtained from the adder 114 25 
and supplied to the copying processffig execution unit 
63 of FIQ. 9. 

Having now fully described the inventioa it will be 
apparent to one of ordinary skill in the art that many 
changes and modifications can be made thereto witiiout so 
departing from the spirit and scope of the invention as 
set forth herein. 

Claims 

35 

1 . An image data illegal use prevention system, char- 
acterized in that it comprises: 

image data fetching means (6; 16; 26; 41 ; 51) 
for fetching digital image data in which elec- 40 
tronk; watermark data may be embedded; 
electronic watermark data detection means (8; 
18; 28; 43; 53) for detectkig electronfo water- 
mark data from the image data fetched t>y saki 
image data fetching means (6; 16; 26; 41 ; 51); 45 
arxj 

transfer inhbition means (7; 17; 27; 42; 52) for 
inhibiting, if electronic watermark data are 
detected by said electronic watermark data 
detection means (8; 1 8; 28; 43; 53), transfer of so 
the image data fetched by said image data 
fetching means (1; 11; 21; 31; 61) to a transfer 
destination (9; 19; 29; 44; 54). 

2. An image data illegal use pro/entfon system, char- 55 
acterized in that it comprises; 

image data fetching means (6; 16; 26; 41; 51) 



for fetching digital image data in which elec- 
tronic watermark data may be embedded: 
electronic watermark data detection means (8; 
18; 28; 43; 53) for detecting electronic water- 
n^arkdata from the Image data fetched by sakl 
image data fetching means (6; 16; 26; 41 ; 51); 
and 

transfer nrwans (7; 17; 27; 42; 52) for transfer- 
ring, if electronic water mark data are detected 
by said electronic watermark data detection 
means (8; 18; 28; 43; 53). data different from 
tiie image data fetched by said image data 
fetching means (1 ; 1 1 ; 21 ; 31 ; 61) to a transfer 
destination (9; 19; 29; 44; 54). 

3. An image data illegal use inhbition system as set 
forth in daim 2. characterized in that the different 
data are data obtained by superposing data 
obtained by nxjltiplying the electronic watermark 
data by a constant on the image data fetched by 
said image data fetching means (6; 16; 26; 41 ; 51). 

4. An image data illegal use prevention system, char- 
acterized in that it comprises: 

image data fetching means (66) for fetching 
digital image data in which electronic water- 
mark data may be embedded; 
electronic watermark data detection means 
(64) for detecting tiie electronic watermark data 
from the image data fetched by said image data 
fetching means (66); and 
transfer inhbition means (63) for discriminating 
whether the detected electronic watermark 
data indicate transfer permission or inhibition 
and inhit>iting, when the detected electronic 
water mark data indicate transfer inhibitfon. a 
transferring operation of the fetched image 
data to a transfer destination (67). 

5. An image data Olegal use inhbition system as set 
fbrtti In daim 4. characterized in that said transfer 
inhbition means (63) discriminates, when the 
detected electronic watermark data indude a value 
representing that the transfer permission time 
number is zera that the detected electronic water- 
mark data are electronic watermark data indicating 
transfer Inhbition. 

6. An image data illegal use Inhbition system, charac- 
terized in that it comprises: 

image data fetching means (66) for fetching 
digital Image data In which electronic water- 
mark data induding a vahje Indicating that the 
transfer permission time number is m may be 
embedded; 

watermark data embedding means (64) for 
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embedding, into the fetched image data, new 
electronic waternriark data which includes a 
value indicating that the transfer permission 
time number is smaller by one than the preced- 
ing value of m; and 

transfer means (63) for transferring the image 
data in which the new electronic watermark 
data are embedded to a transfer donation 
(67). 
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7. An image data illegal use inhibition system as set 
forth in any one of claims 1 to 6. characterized in 
that the electronic watermark data are calculated in 
accordance with a predetermined expression using 
frequency components of the digital image data is 
obtained by disaete cosine transform. 

8. An image data illegal use inhbition system as set 
forth in any one of claims 1 to 7. characterized in 
that said image data fetching means (6; 16; 26; 41 ; 20 
51 ; 66) fetches digital image data from a recorcfing 
medium (5; 15; 25; 35; 69) on which the digital 
image data are recorded, and the transfer destina- 
tkHi is a recording medium (9; 19; 29; 44; 54. 70) 
different from the recording medium (5; 15; 25; 35; 25 
69) on which the digital image data are recorded. 
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(54) Image data Illegal use prevention system 

(57) An Iniage data illegal use prevention system 
includes an image data fetcNng unit (6) for fetdiing dig- 
ital image data in which electronic watermark data may 
be embedded, and an electronic watermark data detec- 
tion unit (8) for detecting electronic watermark data from 
the image data fetched by the image data fetching unit 
(6). If electronic watermark data are detected by the 
electronic watermark data detection unit (8), then an 
image data recording unit (7) does not record the image 
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recording medium (9), thereby preventing illegal dupli- 
cation. The electronic watern^k data are calculated, 
for example, in accordance with an expresston deter- 
mined in advance for frequency components of discrete 
cosine transformed digital image data. 
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